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Outline 
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□ Data collection 

□ Diagnostic system development 

□ Prognostic system development 

□ Laboratory experiments 

□ Flight experiments 

□ Summary 
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Terminology 
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Diagnostics and Prognostics Group at NASA Ames 


• Areas of work 

- Diagnostic systems 

- Prognostic systems 

- Decision-making systems 

- V&V techniques 

• Components and systems studied 

- Electro-mechanical actuators 
— Power electronics 

- Batteries 

- Composite structures (in collaboration with Stanford University) 

- Cryogenic refueling systems (in collaboration with NASA Kennedy) 

• Methods 

- Discrete model-based diagnosis - Livingston 

- Hybrid (discrete/continuous) diagnosis - HyDE 

- Model-based prognosis - particle filters, Kalman filters 

- Data-driven prognosis - neural networks, Support Vector Machines, Gaussian Process 
Regression 

- Decision-making - stochastic optimization methods, game-theoretic methods, dynamic 
programming 
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Diagnostics and Prognostics Group (continued) 


• Test facilities 

- EMA testbeds 

- ADAPT (Advanced Diagnostics and Prognostics Testbed) - aircraft power distribution 

- Electrical battery aging testbed 

- Electronics aging testbeds (for MOSFETs, IGBTs, and capacitors) 

— An environmental chamber (temperature, pressure, and humidity) 

• Test vehicles 

- Kll planetary rover prototype 

- Edge 540 UAV (NASA Langley) 

— UH-60 Blackhawk helicopters (US Army at NASA Ames) 



Diagnostics and Prognostics of Electro-Mechanical Actuators, EU/IEEE FDD Workshop, Toulouse, France, Oct 23-26, 2012 


6 


Motivation for EMA Health Management 


• EMA are becoming a component critical to aircraft and spacecraft safety 

• Performance data on EMA, both laboratory and in-flight, is scarce 

• A variety of fault types can occur (discrete/continuous, abrupt/incipient) 
in a variety of subsystems (mechanical, electrical, control system, or 
sensor). 

• We need to be able to diagnose faults quickly and accurately, to enable 
prognosis and mitigation 

• We believe that collecting and testing on high-quality nominal and fault- 
injected data is essential to developing effective EMA health 
management systems 
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Objectives 


• Collect data on nominal and faulty Electro-Mechanical Actuator (EMA) 
performance 

• Develop fault-detection and fault-propagation models 

• Develop diagnostic systems 

• Verify models and validate diagnostic systems using laboratory and field 
data sets 

• Develop and evaluate model-based prognostic health management (PHM) 
systems 

• Integrate with other aircraft subsystem PHM modules and a high-level 
vehicle health reasoner 
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Nominal and fault modeling 


• Fault analysis 

• Lubricant effects modeling 

• Micro-scale mechanical modeling 

• Wear modeling 

• Winding shorts modeling 

• Functional system models 
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Experimental Data Collection 


Capabilities: 


• 5 metric ton load capacity 

• Accommodation of test 
actuators of various sizes and 
configurations 

• Custom motion and load 
profiles 

Sensor Suit: 

• Vibration 

• Load 

• Temperatures sensors 



• High-precision position 
sensors 


• Current sensors 
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The FLEA (Flyable Electromechanical Actuator) 


• Allows diagnostic and prognostic experiment execution in 
realistic conditions 

• Designed to function as an unobtrusive secondary payload 

• No aircraft modifications are required 

• Experiments can be done during virtually any flight opportunity 

• Designed to be quickly adaptable to different types of aircraft 

• Faults can be injected without endangering the host aircraft 
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The hardware 



Major hardware components 

• Two test actuators 

• Load actuator 

• Magnetic coupling system 

• Motion controller 

• Central computer 

• DAQ system 

• Sensors 

• Data storage system 




Sensor suite 

• High Speed (20kHz) 

• Accelerometers 

• Low speed (1kHz) 

■ current sensors 

■ voltage sensors 

■ position sensors 

■ temperature 
sensors 

■ load cell 


Major software components 

• Control system 

• GUI 

• Signal processing and data 
extraction 

• Diagnostic system 

• Prognostic system 

• Experiment recording and 
data archival system 
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Operation 



• An aircraft actuator is selected to be "mimicked" 

• FLEA operates in parallel with the selected actuator, executing the same motion 
and load profiles 

• Load profiles are calculated from aerodynamic data and scaled down for the FLEA 
range, if necessary 

• One test actuator is kept nominal, the other one is fault-injected 


• Load path can be switched in-flight from 
the nominal test actuator to the fault- 
injected one, via the magnetic coupling 



Test actuators 
Load actuator 

Nut accelerometers 

Coupling magnets 


Rigid bar on 
guide rails 
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Test Articles - UltraMotion Bug Actuators 


Quiet 

Ketvar-Polyurathane 
Drive Belt 


Adjustible 
Slip Clutch 


Low Inertia 
Composite 
Pulley 


Various 

Motor 

Options 


Anodized 

Aluminum 


Wiper Seal °-**?*»' 



High-Load 

Bearing 

Assembly 


Polished 
Stainless 
Steel Shaft 


Bidirectional 

End-of-Stroke 

Cushion 


Anti-Rotation 

Collar 


Precision 

Linear 

Potentiometer 


Mechanism type 

B allscrew with a DC electric 
motor 

Screw thread pitch 

0.125 in/rev 

Efficiency 

98% 

Dynamic load 

5000 lb*in/sec (100% duty 
cycle) 

Motor stall torque 

41.3 oz/in 

Motor no-load speed 

102.5 rev/sec 

Motor stall current: 

8.11 amps 

Motor no-load current: 

0.16 amps 
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Hybrid Diagnostic System 


Low speed 
data 



Qualitative 

Classifier 


Fault candidates 
ambiguity set 


High speed 
data 



f 


Quantitative 

Classifier 


Final diagnosis 


► 


Hybrid model / feature- 
driven approach 

Qualitative analysis on 
low speed data to 
reduce the possible 
fault set 

The reduced fault set 
disambiguated by 
looking for specific 
features in high speed 
data 

Runs continuously, 
updating its belief about 
the system health as 
more data becomes 
available 
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Hybrid Diagnostic System (more details) 


* Qualitative analysis 

- Qualitative signatures of fault derived from model as well as data from faulty runs. 

- An observer uses differential equations to track plant behavior 

- Qualitative symbols generated when predicted behavior (from observer) is not 
consistent with actual behavior (sensor data) 

- Comparison of symbols and signatures results in reduction of possible fault set 



* Disambiguation 

- Features selected based on diagnosability analysis of qualitative approach 

- Features specific to selected ambiguity group 
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Qualitative Fault Diagnostic Architecture 
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Fault Detection 



• For each sensor, residual r(r) = y(t) - y(t) 

• Ideally, residual is zero, use Z-test to determine if nonzero residual is statistically 
significant 

• Use set of sliding windows 

— W 1 computes variance of nominal residual 
— W 2 computes mean of residual at time k 

- W de | ay ensures computation of variance does not include samples from after fault 
appearance 

• Compute thresholds using Z-test and selected confidence intervals 

- Residual mean outside thresholds implies fault 
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Symbol Generation 


• Qualitative approach based on analysis of fault transients 

• Magnitude and slope deviations from nominal behavior abstracted as + (increase), 
- (decrease), and 0 (no change) symbols 

• Symbols generated using a sliding-window scheme similar to the Z-test 

• Fault signatures are predictions of how the magnitude and slope of a 
measurement will deviate from nominal under each fault case 

• Represented using symbol pair for measurement and slope 

• Fault isolation performed by comparing observed measurement deviations to 
predicted deviations 
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Data-Driven Fault Disambiguation 


• After an ambiguity set is obtained, the data-driven disambiguation module is 
triggered 

• De-noising is carried out in real-time and appropriate features are computed 

• Accelerometer data conditioning and de-noising is carried out by characterizing 
noise levels when actuators are stationary (e.g. during parts of trapezoidal profiles) 

• Noise characterization constitutes determination of bias and noise variance 
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High Speed Data Feature Extraction 


• Average Signal Energy (ASE) used as the feature to distinguish between jam and spall faults 

• The feature separates the jam and the spall faults well 

- Spall faults are significantly higher in energy than the corresponding nominal scenarios 

- Jammed actuator does not move easily, hence has lower vibration energy 

• Depending on the motion profile and load levels the energy varies (inherently) between different 
operational profiles 

• Features are normalized by a measure of this inherent energy 

• Fault disambiguation success rate was ~90% (100% for spalls and 80% for jam faults) 

• Due to noise some low energy jammed scenarios were not diagnosed 
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Laboratory Experiments 



• Faults introduced 

- Actuator ball return channel jam (discrete, abrupt) 

- Lead screw spall (continuous, incipient) 

- Motor failure (discrete, abrupt) 

- Sensor dead (discrete, abrupt) 

- Sensor bias & scaling (continuous, abrupt) 

- Sensor drift (continuous, incipient) 

• Profiles 

- UH-60 Forward Primary Servo (collected in flight) 

— Laboratory experiments with a wide variety of motion and load profiles 

• Total experiments = 320 


Nominal = 134 
Jam = 15 
Spall = 15 
Motor failure = 15 
Sensor faults= 141 
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Results - Diagnosis Accuracy 


Fault 

Type 

Total 

Scenarios 

Correct 

Diagnosis 

Diagnosis 

Accuracy 

Nominal 

134 

133 

99.25 

Current Sensor Biased 

15 

15 

100.00 

Current Sensor Dead 

15 

15 

100.00 

Current Sensor Drift 

15 

15 

100.00 

Position Sensor Fault 

21 

13 

61.90 

Current Sensor Scaling 

15 

15 

100.00 

Ball Screw Return Channel Jam 

15 

10 

66.67 

Motor Failure 

15 

15 

100.00 

Lead Screw Spall 

15 

15 

100.00 

Temperature Sensor Bias 

15 

15 

100.00 

Temperature Sensor Dead 

15 

15 

100.00 

Temperature Sensor Drift 

15 

15 

100.00 

Temperature Sensor Scaling 

15 

15 

100.00 

Total 

320 

306 

95.625 
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Prognostic Algorithm 


• Prediction algorithm: a Gaussian Process Regression (GPR) with neural network 
covariance function (with a noise parameter) was used 

~ T 7~) —1 ~ 

X r /V* 

j J- A/ j 

+ xfp -1 * ; J(l - xf P -1 *,- ) I 
X = (l ,x 1 ,x 2 ,...,x d ) T ,P = cl 


k^ix^Xj) = asin 


-l 




• Results aggregated based on 50 runs with randomized training data selection and 
hyper-parameter initialization 
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Speed (in/sec) 


Prognostic Validation Scenario 



Jam was injected into the ball screw return 
channel of a test actuator on the FLEA 

Performance region picked where a nominal 
actuator can operate continuously for extended 
periods of time (100% duty cycle) 

Motion and load profiles were designed to stay 
inside this region - sine wave with 8 cm (3.15 in) 
peak-to-peak amplitude, 0.5 Hz frequency, and 
the following load levels: -50, +40, and +50 lbs 

Motion was performed in 30 second intervals, 
with 15 second cool-down periods in-between 



5. Current was limited to 6 amps @ 28 volt for the 
entire system at all times 

6. Experiments were executed until actuator 
motors failed due to temperature build up and 
consequent windings insulation failure 

7. Failure occurs at approximately 88 degrees C 
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Run-to-Failure Experiments 


EMA Run-to-Failure Data 



+40 lbs Run 2 
filtered +40:2 
- 50 lbs 
filtered -50 
+ 50 lbs 
filtered +50 
Failure Threshold 


Time (sec) 


Diagnostics and Prognostics of Electro-Mechanical Actuators, EU/IEEE FDD Workshop, Toulouse, France, Oct 23-26, 2012 


26 


Temperature (C) Temperature (C) 


End of Useful Life Prediction Results 


Life Prediction for EMA under Load Level 1 (+40lbs sine36) 



Life Prediction for EMA under Load Level 3 (-50 lbs sine51 ) 



Life Prediction for EMA under Load Level 2 (+50 lbs sine50) 



Fail threshold = 88C 

Onset of detectable damage: 40C 

+40 lbs sine36 Load Condition 
t p1 = 890 MAPE = 6.62%; 2a = 215s 

+50 lbs sine50 Load Condition 
t p1 = 360 MAPE= 4.76%; 2a = 60s 

-50 lbs sine51 Load Condition 
t p1 = 890 MAPE = 8.02%; 2a = 338s 


* Colored bands around the predictions on the right-hand plots are the 2o > bounds 
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Flight Tests on UH-60 Black Hawk Helicopters 


• Spall and ballscrew jam 
faults injected into the 
test actuators 

• Improved data 
acquisition system 
tested 

• Diagnostic system tested 

• Some prognostic 
experiments executed 



Test Actuator Motion Profile 



Desired Load Profile 
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Recent progress 


• Diagnostic and prognostic algorithm improvements 

• Hardware improvements: 

- New accelerometer signal conditioner 
— Winding shorts simulator 

— Robustness improvements 

• Sensor fault experiments 

- Position sensors (stuck) 

- Temperature sensors (bias, scaling, drift) 

- Current sensors (bias, scaling, drift) 

- Hundreds of fault scenarios with different parameters performed 
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Summary 



• Hardware testbeds, for both laboratory and flight environment, have been 
developed 

• Prototypes of a hybrid diagnostic system and a GPR-based prognostic 
system created 

• Various types of fault modes injected, both in software and hardware 

• Tests performed to validate performance in nominal and fault-injected 
scenarios 

• Experimental data is available on NASA Ames DASHLink website: 


https://c3.ndc.nasa.gov/dashlink/ 
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Thank you! 
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